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Voxel-based morphometry (VBM) is a commonly used method to study volumetric varia- 
tions on a whole brain basis. However, it is often criticized for potential confounds, mainly 
based on imperfect spatial registration. We therefore aimed to evaluate if VBM and "gold 
standard" manual volumetry are measuring the same effects with respect to subcortical 
gray matter volumes. Manual regions-of-interest were drawn in the hippocampus, amyg- 
dala, nucleus accumbens, thalamus, putamen, pallidum, and caudate nucleus bilaterally. 
Resulting volumes were used for a whole brain VBM correlation analysis with Statistical 
Parametric Mapping (SPM8).The hippocampus, amygdala, putamen, and caudate nucleus 
were correctly identified by SPM using the contemporary high-dimensional normalization 
(DARTEL toolbox). This strongly suggests that VBM and manual volumetry both are indeed 
measuring the same effects with regard to subcortical brain structures. 

Keywords: voxel-based morphometry, manual volumetry, validation, DARTEL, mixed psychiatric sample 



INTRODUCTION 

Since its first description in the late 1990s (1, 2) voxel-based mor- 
phometry (VBM) has gained much attention in the neuroscience 
community and has been applied to pathological and physiologi- 
cal conditions alike. However, from the very beginning there was 
a general discussion about the validity of the underlying spatial 
normalization process with the notion that anatomical localiza- 
tion could not be trusted (3). It was hypothesized that global 
volumetric alterations can be mistaken for local effects. There are 
several reports in the literature that VBM findings could not be 
replicated by repeat studies or manual validation, e.g., in schizo- 
phrenia (4), which can be regarded as lack of robustness of the 
method. In the last years, however, revised segmentation (5) and 
spatial normalization techniques (6) have been described that have 
improved registration accuracy and thus statistical power (7, 8) . To 
measure volumetric alterations, manual region of interest (ROI)- 
based methods are still regarded as gold standard by many authors 
but these are much more time-consuming, subject to operator 
biased, and require a priori anatomical constraints. So far sys- 
tematic comparisons of automated VBM and manual ROI-based 
methods have shown conflicting results. One study has reported a 
superiority of ROI volumetry in physiological aging with an over- 
estimation of age-related differences in regional brain volumes 



by VBM (9); another study found VBM to be equally specific in 
detecting local volumetric alterations in expected regions but also 
capable of detecting remote volume loss in Huntington disease 
patients (10). 

Although VBM- and ROI-based methods are, in principle, 
measuring similar effects (usually gray volume alterations), the 
underlying principle is quite different. In the present study, we 
aimed to investigate whether ROI-based manual volumetry of 
subcortical brain structures and contemporary VBM in SPM8 
(DARTEL toolbox) provide directly correlated results and if these 
results show anatomical specificity in a large sample of psychi- 
atric patients and healthy controls recruited for different, in part 
diagnosis-specific, projects of our group. To this end, we obtained 
manual ROI-derived absolute volumes of subcortical gray matter 
structures and used these as main effect regressors in a VBM analy- 
sis. It was expected that VBM would show significant correlations 
anatomically associated to the subcortical structure in question. 

MATERIALS AND METHODS 

One hundred and sixty-three subjects participated in the study. 
The study sample comprised healthy controls (N = 54) and psy- 
chiatric patients diagnosed with schizophrenia (N = 41), bipo- 
lar affective disorder (N = 41), or obsessive-compulsive disorder 
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Table 1 | Demographic and clinical data of study subjects. 

All subjects Healthy controls Schizophrenia patients Bipolar patients OCD patients 

(n=163) (n = 54) (n = 41) (n = 41) (n = 27) 



Age (years) 

Gender (M/F) 

Years of education 

Duration of illness in years 

MADRS 

CGI 

BDI 

PANSS 

YMRS 

Y-BOCS 

CPZ dose equivalents 



36.9± 12.1 

83/80 
13.6±2.8 



39.6±12.3 

21/33 
15.4±2.7 



28.4 ±7.1 
28/13 
12.7±2.7 

0.7 ±1.2 
12.3±8.2 

4.1 ±0.9 
14.5±8.7 
88.9 ±27.7 



320.5 ±303.4 



43.2±12.2 

21/20 
13.9±2.9 
13.9±10.6 
4.6±3.5 
3.4±1.7 
7.6 ±10.4 

2.5±2.8 

244.7 ±425.3 



35.1 ±9.8 
13/14 

12.7±2.0 

13.7±9.6 
9.7 ±7.3 
3.9 ± 1.2 

13.0±10.4 



21.0±9.1 



M/F male/female; MADRS, Montgomery-Asberg Depression Rating Scale; CGI, clinical global impression; BDI, Beck Depression Inventory; PANSS, Positive and 
Negative Syndrome Scale; YMRS, Young Mania Rating Scale; Y-BOCS, Yale-Brown Obsessive-Compulsive Scale; CPZ, chlorpromazine dose equivalent (daily), ±SD. 



(AT = 27). The mean age was 36.9 ± 12.1 years (range 16-65), 80 
subjects were female (see Table 1). The groups were not matched 
for age and gender; therefore these parameters were included into 
the voxel-based analysis as covariates of no interest. All subjects 
gave informed consent and the investigations were approved by 
the local ethics committee. 

Structural magnetic resonance imaging (MRI) was carried out 
using a 1.5 T scanner (Siemens Sonata, Erlangen, Germany). A 
Tl-weighted MPRAGE sequence (TE = 4.42 ms, TR= 1900 ms, 
TI = 700 ms, flip angle =15°, FOV 256 mm x 256 mm) of 
176 consecutive slices was acquired with a voxel size of 
1 mm x 1 mm x 1 mm. Manual ROIs were drawn using the soft- 
ware packages Analyze (1999; Mayo Foundation, Rochester, MN, 
USA), MRIcro (http://www.cabiatl.com/mricro/) as well as in- 
house IDL applications as previously described (11-14). First, 
the magnetic resonance images were realigned in parallel to the 
anterior commissure-posterior commissure plane. Trained sin- 
gle operators, blinded to the diagnosis, drew outlines of the ROI. 
These outlines were evaluated for accuracy in the perpendicular 
cutplanes. The ROI volumes were determined using automatic 
algorithms programed in MATLAB. ROIs were drawn for the 
hippocampus, amygdala, nucleus accumbens, thalamus, putamen, 
pallidum, and caudate nucleus separately for both sides. ROI delin- 
eation was done step by step in subsamples by trained single 
operators. All ROI analyses were initially realized in subsamples 
over a recruitment period of 4 years in order to answer other scien- 
tific, in part diagnosis-specific, questions in the context of different 
projects of our group. As recruitment was continued after some 
subsamples had been analyzed by manual morphometry, ROI data 
was not available for all MRI data sets. The current approach has 
the advantage that manual volumetry was performed by only one 
single, trained operator for each ROI without any bias by adding 
post hoc ROI data. Details of the available ROIs per group are given 
in Table 2. 

PROTOCOL FOR REGION OF INTEREST DELINEATION 

Caudate nucleus (caput): ROIs were drawn on the coronal sections 
including all gray matter voxels. The tail was not included since this 



Table 2 | Available ROI volumes per region and group. 





SZ 


BPD 


OCD 


Controls 


All 


Hippocampus 


41 


38 


26 


53 


158 


Amygdala 


39 


41 


8 


54 


142 


Accumbens 


0 


16 


17 


18 


51 


Caudate 


0 


16 


17 


18 


51 


Pallidum 


0 


16 


17 


18 


51 


Putamen 


0 


16 


17 


18 


51 


Thalamus 


0 


16 


17 


18 


51 



SZ, schizophrenia patients; BPD, bipolar affective disorder patients; OCD, 
obsessive-compulsive disorder patients. 



encompasses only very few voxels and is difficult to trace unam- 
biguously. Putamen: this region was drawn on the axial sections 
with a lateral border at the external capsule, the anterior-medial 
border at the internal capsule and the posterior-medial border 
defined by the white matter voxels between putamen and pal- 
lidum. Pallidum: this region was also drawn on the axial sections 
and included all gray matter voxels between the putamen as 
lateral border and the internal capsule as medial border. The 
ROI included the lateral and medial parts of the structure as a 
whole. Nucleus accumbens: this region was drawn on the coro- 
nal sections. It was delimited by the inferior border of the head 
of the caudate nucleus, the internal capsule, and the anterior- 
medial border of the putamen. Thalamus: this structure was 
outlined as a whole on the coronal sections and was defined 
by the posterior aspects of the internal capsule and the third 
and lateral ventricles as medial and posterior margins, see also 
Radenbach et al. (13). Hippocampus: this region was drawn on 
sagittal sections and checked in the other coronal and horizon- 
tal views, see Pajonk et al. (11). Amygdala: this region was drawn 
in the coronal sections. The anterior border was defined by the 
point when the amygdala became too diffuse to be resolved from 
the temporo-polar cortex. The superior and lateral borders were 
defined by the temporal lobe white matter and the inferior border 
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by the white matter of the parahippocampal gyrus as previously 
described (12, 14, 15). 

VOXEL-BASED ANALYSIS 

Images were converted to NIFTI format and processed on 
an offline Linux workstation using SPM8. The images were 



segmented into gray and white matter tissue classes and spa- 
tially normalized according to the SPM8 DARTEL procedure with 
default settings in 1.5 mm cubic resolution and MNI space using 
a custom, sample-derived template (6). The normalized gray mat- 
ter maps were modulated with the resulting Jacobian determinant 
maps and smoothed with an 8-mm FWHM Gaussian kernel. Total 
intracranial volume (TIV) was estimated by adding up the native 
space volumes of the gray matter, white matter, and CSF maps in 
MATLAB. The GLM analysis was in turn set up for each ROI in a 
multiple regressions design with the absolute, manually measured 
ROI volume as main effect and including diagnosis group, age, 
gender, and TIV as covariates of no interest (Figure 1). One-tailed 
t contrasts were then generated using family wise error rate (FWE) 
correction with a p < 0.05 and, additionally (as exploratory test), 
with an uncorrected p < 0.0001 threshold. 

RESULTS 

There was a strong positive and significant right-left correla- 
tion between all manually drawn ROI volumes (Pearson cor- 
relation coefficients were calculated between all right and left 
subcortical volumes: hippocampus r = 0.361, p < 0.001; amygdala 
r = 0.813, p < 0.001; nucleus accumbensr = 0. 695, p < 0.001; cau- 
date r = 0.927, p < 0.001; pallidum r = 0.687, p < 0.001; putamen 
r = 0.938, p < 0.001; thalamus r = 0.754, p < 0.001; all two-sided 
significant). 

Details of the SPM results using DARTEL processing are given 
in Table 3, overview glass brain images are shown in Figure 2, 
exemplary axial cutplane images in Figure 3. 

SPM detected significant correlations (p < 0.05 FWE- 
corrected) of the manually measured ROI volumes and the 
anatomically corresponding gray matter volume as measured by 
VBM in both hippocampi, both caudate nuclei, and both putam- 
ina. Interestingly, in all these analyses the structure in question was 
detected bilaterally, sometimes with slightly higher T-scores on the 
contralateral side. For the amygdala ROI, only the respective con- 
tralateral structure survived the error correction; however, with 
the exploratory threshold both amygdalae were detected. For the 
pallidum and nucleus accumbens ROIs, no suprathreshold clusters 
could be found both with the conservative FWE-corrected analysis 
as well as with the uncorrected p < 0.000 1 threshold. The thalamus 
ROI volumes also showed no suprathreshold correlations within 
the structures in question. With an even lower significance thresh- 
old of p < 0.001 (uncorrected), the left pallidum and both thalami 
could be identified, but with this threshold 20 (left pallidum), 
19 (left thalamus), or 46 (right thalamus) suprathreshold clusters 
outside the ROI would also be detected (data not shown). 

DISCUSSION 

In this study, we assessed whether voxel-based morphometric 
analyses using SPM8 (DARTEL) and manual volumetry would 
show results consistent with each other in a mixed sample 
of patients with schizophrenia, bipolar affective disorder, and 
obsessive-compulsive disorder and healthy controls. In partic- 
ular, we performed GLM analyses by entering the manually 
determined volumes of different ROIs in a (multiple) regres- 
sion design. From a theoretical point of view, the observed 
variations of the ROTmeasured subcortical volumes should be 
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Table 3 | SPM results (DARTED 
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Anatomical position 
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Anatomical position 
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Right hippocampus 
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Right putamen 


pocampus 
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9-7 

putamen Zl 


C 99 
O.ZZ 
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ZD lz lz 


Right insula 






7.38 


32 -13 -20 




36 


6.13 


-24 6 15 


Left putamen 




776 


6.24 


-14 -36 3 


Left hippocampus 


19 


5.70 


-15 9 -2 


Left putamen 






5.98 


-24 -31 1 




14 


5.57 


-48 -61 40 


Left lateral occipital cortex 






5.86 


-6 -31 10 




4 


5.44 


-18 15 -8 


Left putamen 






5.59 


-30 -15 -18 


















Left N/A 


4.97 


-26-70-9 


Left amygdala 




33 


5.10 


15 28 -27 


Right fronto-orbital 










pallidum N/A 


4.75 


21 27-8 


Frontal orbital cortex 




12 


4.90 


20 -33 -15 


Right parahippocampai gyrus 


N/A 


4.66 


2-4-14 


No label found 


Right hip- 


466 


6.60 


33 -18 -15 


Right hippocampus 


N/A 


4.44 


33 39 -9 


Right frontal pole 


pocampus 


209 


5.64 


_30 -16 -18 


Left hippocampus 


N/A 


4.36 


-38 -28 49 


Left postcentral gyrus 
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-26 -33 0 




N/A 


4.31 


14 23 -5 
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-32 -24 -9 




















Right 
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Left 
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anterior callosum) 


Left 


No suprathreshold clusters at p < 0.05 (FWE) 
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Left inferior temporal gyrus 


accumbens 
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All significant clusters/sub-clusters as given by SPM (DARTEL processing stream) 
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at a threshold of p < 


0.05 (corrected with FWE) are shown. T-scores (T) are peak 
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Right caudate 


level per cluster, local maxima are grouped and ordered according to T-score. 
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Lines in italics are from the exploratory test (p< 0.0001 uncorrected) and are 
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given when the structure in question did not survive error correction (clusters 
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Left angular gyrus 


In fact, these hypotheses were confirmed in the DARTEL pro- 



cessing stream for both hippocampi, amygdalae, caudate nuclei, 
(Continued) and putamina, but not for the nucleus accumbens, thalamus, 
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DARTEL FWE p<0.05 DARTEL p<0.0001 (uncorr.) 

Sil iffly Sill tf.i^te 




FIGURE 2 | SPM results in glass brain projection. SPM glass brains for 
different regions and thresholds [p < 0.05 (FWE corrected) and p < 0.0001 
(uncorrected)] are shown. Images are in neurological convention (left in the 
image is left in the subject). FWE, family-wise error correction; DARTEL, 
normalization done with DARTEL-toobox; HC, hippocampus; AM, amygdala; 
CN, caudate nucleus; PU, putamen. 



and pallidum. These would have required even lower signifi- 
cance thresholds (p < 0.001 and less) that are usually not accept- 
able in a whole brain analysis. Several possible explanations may 
account for the partially negative results in these regions. The 
nucleus accumbens is difficult to outline in manual volumetry 
due to proximity to the caudate nucleus and putamen. Thal- 
amus and pallidum on the other hand are structures that are 
not homogenously segmented as gray matter by SPM: the thal- 
amus is divided into multiple subnuclei with intersecting white 
matter tracts, whereas the manual ROI tracing was done fol- 
lowing the outer boundaries of the structure as a whole. The 
pallidum is iron rich causing susceptibility effects and automated 
standard methods based on Tl -weighted images often fail to seg- 
ment this structure correctly (16). Also for these regions, the 
available N was lower in comparison to the hippocampus and 
amygdala. Nevertheless, as the same N was sufficient to show 
strong correlations in the caudate and putamen, it is unlikely 
that this effect was purely power-dependent. Another interest- 
ing finding is the strong bilaterality of correlations in the VBM 
results. As the manually measured volumes were also strongly 
right-left correlated, the contralateral structure in question was 
always detected in the VBM analysis as well, sometimes even with 
slightly higher significance levels. This highlights that, in a mixed 
sample of psychiatric patients and controls, volume alterations 
are not strongly lateralized. This is in keeping with a large meta- 
analysis of hippocampus volumes in schizophrenic patients that 
found a highly significant volume loss without any side pref- 
erence (4). Also in depression, amygdala volumes were affected 
bilaterally although the direction of alterations seems to be influ- 
enced by drug effects (17). Another MRI study reported reduced 
thalamic volumes in major depressive disorder, which was also 
symmetric (18). 

With a clear hypothesis or with an exploratory intention, 
it can be useful and justified to apply a more liberal signifi- 
cance threshold, e.g., p < 0.0001 (uncorrected). In our sample, 
this was necessary to detect the ipsilateral amygdala that would 
not have survived full-brain FWE correction. This approach did, 
however, impact on specificity as additional clusters occurred 
outside the principal ROI (Table 3). Of note, covariance in 
homotopic, but also ipsilateral and heterotopic gray matter 
densities measured by VBM has been reported (19) and is 
seen, for example, in age-related decline (20). Therefore, these 
additional clusters may be explained by structural covariance, 
although it cannot be excluded that some are spurious. In 
summary, we could demonstrate that VBM, particularly the 
contemporary DARTEL-based variant, is in fact measuring the 
same effect as manual volumetry in most subcortical regions 
and shows high anatomical specificity. Further studies, how- 
ever, are needed to evaluate the impact of VBM for cortical 
regions. 
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FIGURE 3 | Superimposed SPM results. Thresholded SPM results 
(uncorrected p< 0.0001) superimposed on the averaged T1-weighted images 
of all subjects are shown. The color scale represents SPM t-scores, images 



are in radiological convention (left in image is right in the subject). Rows are 
different seed regions: (A) left hippocampus, (B) right hippocampus, (C) left 
amygdala, (D) right amygdala, (E) left caudate nucleus, (F) left putamen. 
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